Reducing Objective Function Mismatch in Deep Clustering with the Unsupervised Companion Objective
نویسندگان
چکیده
Preservation of local similarity structure is a key challenge in deep clustering. Many recent clustering methods therefore use autoencoders to help guide the model's neural network towards an embedding which more reflective input space geometry. However, work has shown that autoencoder-based models can suffer from objective function mismatch (OFM). In order improve preservation structure, while simultaneously having low OFM, we develop new auxiliary for Our Unsupervised Companion Objective (UCO) encourages consistent at intermediate layers -- helping learn space. Since clustering-based same goal as main objective, it less prone introduce between itself and objective. experiments show attaching UCO model improves performance model, exhibits lower compared analogous model.
منابع مشابه
The Minimum Rank with Hysteresis Objective Function
The Routing Protocol for Low-Power and Lossy Networks (RPL) constructs routes by using Objective Functions that optimize or constrain the routes it selects and uses. This specification describes the Minimum Rank with Hysteresis Objective Function (MRHOF), an Objective Function that selects routes that minimize a metric, while using hysteresis to reduce churn in response to small metric changes....
متن کاملMulti-Objective Search Results Clustering
Most web search results clustering (SRC) strategies have predominantly studied the definition of adapted representation spaces to the detriment of new clustering techniques to improve performance. In this paper, we define SRC as a multi-objective optimization (MOO) problem to take advantage of most recent works in clustering. In particular, we define two objective functions (compactness and sep...
متن کاملMulti-Objective Deep Reinforcement Learning
We propose Deep Optimistic Linear Support Learning (DOL) to solve highdimensional multi-objective decision problems where the relative importances of the objectives are not known a priori. Using features from the high-dimensional inputs, DOL computes the convex coverage set containing all potential optimal solutions of the convex combinations of the objectives. To our knowledge, this is the fir...
متن کاملObjective Functions for Fuzzy Clustering
Fuzzy clustering comprises a family of prototype-based clustering methods that can be formulated as the problem of minimizing an objective function. These methods can be seen as “fuzzifications” of, for example, the classical c-means algorithm, which strives to minimize the sum of the (squared) distances between the data points and the cluster centers to which they are assigned. However, it is ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the Northern Lights Deep Learning Workshop
سال: 2021
ISSN: ['2703-6928']
DOI: https://doi.org/10.7557/18.5709